Skip to content

{2023.06,zen4}[system] EasyBuild v4.9.1 #547

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 5 commits into from
May 7, 2024

Conversation

trz42
Copy link
Collaborator

@trz42 trz42 commented Apr 20, 2024

Add EasyBuild v4.9.1 to zen4 software subdir.

Only build for zen4 on cluster ...

SPDX license identifier: GPL-2.0-only

Missing packages:

* EasyBuild/4.9.1 (EasyBuild-4.9.1.eb)

@trz42 trz42 added 2023.06-software.eessi.io 2023.06 version of software.eessi.io zen4 labels Apr 20, 2024
Copy link

eessi-bot bot commented Apr 20, 2024

Instance eessi-bot-mc-aws is configured to build:

  • arch x86_64/generic for repo eessi-hpc.org-2023.06-compat
  • arch x86_64/generic for repo eessi-hpc.org-2023.06-software
  • arch x86_64/generic for repo eessi.io-2023.06-compat
  • arch x86_64/generic for repo eessi.io-2023.06-software
  • arch x86_64/intel/haswell for repo eessi-hpc.org-2023.06-compat
  • arch x86_64/intel/haswell for repo eessi-hpc.org-2023.06-software
  • arch x86_64/intel/haswell for repo eessi.io-2023.06-compat
  • arch x86_64/intel/haswell for repo eessi.io-2023.06-software
  • arch x86_64/intel/skylake_avx512 for repo eessi-hpc.org-2023.06-compat
  • arch x86_64/intel/skylake_avx512 for repo eessi-hpc.org-2023.06-software
  • arch x86_64/intel/skylake_avx512 for repo eessi.io-2023.06-compat
  • arch x86_64/intel/skylake_avx512 for repo eessi.io-2023.06-software
  • arch x86_64/amd/zen2 for repo eessi-hpc.org-2023.06-compat
  • arch x86_64/amd/zen2 for repo eessi-hpc.org-2023.06-software
  • arch x86_64/amd/zen2 for repo eessi.io-2023.06-compat
  • arch x86_64/amd/zen2 for repo eessi.io-2023.06-software
  • arch x86_64/amd/zen3 for repo eessi-hpc.org-2023.06-compat
  • arch x86_64/amd/zen3 for repo eessi-hpc.org-2023.06-software
  • arch x86_64/amd/zen3 for repo eessi.io-2023.06-compat
  • arch x86_64/amd/zen3 for repo eessi.io-2023.06-software
  • arch aarch64/generic for repo eessi-hpc.org-2023.06-compat
  • arch aarch64/generic for repo eessi-hpc.org-2023.06-software
  • arch aarch64/generic for repo eessi.io-2023.06-compat
  • arch aarch64/generic for repo eessi.io-2023.06-software
  • arch aarch64/neoverse_n1 for repo eessi-hpc.org-2023.06-compat
  • arch aarch64/neoverse_n1 for repo eessi-hpc.org-2023.06-software
  • arch aarch64/neoverse_n1 for repo eessi.io-2023.06-compat
  • arch aarch64/neoverse_n1 for repo eessi.io-2023.06-software
  • arch aarch64/neoverse_v1 for repo eessi-hpc.org-2023.06-compat
  • arch aarch64/neoverse_v1 for repo eessi-hpc.org-2023.06-software
  • arch aarch64/neoverse_v1 for repo eessi.io-2023.06-compat
  • arch aarch64/neoverse_v1 for repo eessi.io-2023.06-software

@trz42
Copy link
Collaborator Author

trz42 commented Apr 20, 2024

No response from bot on Azure yet 😢 ... checking if it receives an event.

@trz42
Copy link
Collaborator Author

trz42 commented Apr 20, 2024

Seems some issue with the bot config file

json.decoder.JSONDecodeError: Expecting property name enclosed in double quotes: line 3 column 70 (char 133)

@trz42
Copy link
Collaborator Author

trz42 commented Apr 20, 2024

Fixed issue for both arch_target_map and repo_target_map

bot: show_config

Copy link

eessi-bot bot commented Apr 20, 2024

Updates by the bot instance eessi-bot-mc-aws (click for details)

Copy link

eessi-bot bot commented Apr 20, 2024

Updates by the bot instance eessi-bot-mc-azure (click for details)

Copy link

eessi-bot bot commented Apr 20, 2024

Instance eessi-bot-mc-aws is configured to build:

  • arch x86_64/generic for repo eessi-hpc.org-2023.06-compat
  • arch x86_64/generic for repo eessi-hpc.org-2023.06-software
  • arch x86_64/generic for repo eessi.io-2023.06-compat
  • arch x86_64/generic for repo eessi.io-2023.06-software
  • arch x86_64/intel/haswell for repo eessi-hpc.org-2023.06-compat
  • arch x86_64/intel/haswell for repo eessi-hpc.org-2023.06-software
  • arch x86_64/intel/haswell for repo eessi.io-2023.06-compat
  • arch x86_64/intel/haswell for repo eessi.io-2023.06-software
  • arch x86_64/intel/skylake_avx512 for repo eessi-hpc.org-2023.06-compat
  • arch x86_64/intel/skylake_avx512 for repo eessi-hpc.org-2023.06-software
  • arch x86_64/intel/skylake_avx512 for repo eessi.io-2023.06-compat
  • arch x86_64/intel/skylake_avx512 for repo eessi.io-2023.06-software
  • arch x86_64/amd/zen2 for repo eessi-hpc.org-2023.06-compat
  • arch x86_64/amd/zen2 for repo eessi-hpc.org-2023.06-software
  • arch x86_64/amd/zen2 for repo eessi.io-2023.06-compat
  • arch x86_64/amd/zen2 for repo eessi.io-2023.06-software
  • arch x86_64/amd/zen3 for repo eessi-hpc.org-2023.06-compat
  • arch x86_64/amd/zen3 for repo eessi-hpc.org-2023.06-software
  • arch x86_64/amd/zen3 for repo eessi.io-2023.06-compat
  • arch x86_64/amd/zen3 for repo eessi.io-2023.06-software
  • arch aarch64/generic for repo eessi-hpc.org-2023.06-compat
  • arch aarch64/generic for repo eessi-hpc.org-2023.06-software
  • arch aarch64/generic for repo eessi.io-2023.06-compat
  • arch aarch64/generic for repo eessi.io-2023.06-software
  • arch aarch64/neoverse_n1 for repo eessi-hpc.org-2023.06-compat
  • arch aarch64/neoverse_n1 for repo eessi-hpc.org-2023.06-software
  • arch aarch64/neoverse_n1 for repo eessi.io-2023.06-compat
  • arch aarch64/neoverse_n1 for repo eessi.io-2023.06-software
  • arch aarch64/neoverse_v1 for repo eessi-hpc.org-2023.06-compat
  • arch aarch64/neoverse_v1 for repo eessi-hpc.org-2023.06-software
  • arch aarch64/neoverse_v1 for repo eessi.io-2023.06-compat
  • arch aarch64/neoverse_v1 for repo eessi.io-2023.06-software

Copy link

eessi-bot bot commented Apr 20, 2024

Instance eessi-bot-mc-azure is configured to build:

  • arch x86_64/amd/zen4 for repo eessi-hpc.org-2023.06-compat
  • arch x86_64/amd/zen4 for repo eessi-hpc.org-2023.06-software
  • arch x86_64/amd/zen4 for repo eessi.io-2023.06-compat
  • arch x86_64/amd/zen4 for repo eessi.io-2023.06-software
  • arch aarch64/neoverse_n1 for repo eessi-hpc.org-2023.06-compat
  • arch aarch64/neoverse_n1 for repo eessi-hpc.org-2023.06-software
  • arch aarch64/neoverse_n1 for repo eessi.io-2023.06-compat
  • arch aarch64/neoverse_n1 for repo eessi.io-2023.06-software

@trz42
Copy link
Collaborator Author

trz42 commented Apr 20, 2024

bot: build inst:eessi-bot-mc-azure repo:eessi.io-2023.06-software arch:x86_64/amd/zen4

Copy link

eessi-bot bot commented Apr 20, 2024

Updates by the bot instance eessi-bot-mc-aws (click for details)
  • received bot command build inst:eessi-bot-mc-azure repo:eessi.io-2023.06-software arch:x86_64/amd/zen4 from trz42

    • expanded format: build instance:eessi-bot-mc-azure repository:eessi.io-2023.06-software architecture:x86_64/amd/zen4
  • handling command build instance:eessi-bot-mc-azure repository:eessi.io-2023.06-software architecture:x86_64/amd/zen4 resulted in:

    • no jobs were submitted

Copy link

eessi-bot bot commented Apr 20, 2024

Updates by the bot instance eessi-bot-mc-azure (click for details)
  • received bot command build inst:eessi-bot-mc-azure repo:eessi.io-2023.06-software arch:x86_64/amd/zen4 from trz42

    • expanded format: build instance:eessi-bot-mc-azure repository:eessi.io-2023.06-software architecture:x86_64/amd/zen4
  • handling command build instance:eessi-bot-mc-azure repository:eessi.io-2023.06-software architecture:x86_64/amd/zen4 resulted in:

    • no jobs were submitted

@trz42
Copy link
Collaborator Author

trz42 commented Apr 20, 2024

No jobs were submitted ... hmm ... found another glitch in the config. Should be fixed.

bot: build inst:eessi-bot-mc-azure repo:eessi.io-2023.06-software arch:x86_64/amd/zen4

Copy link

eessi-bot bot commented Apr 20, 2024

Updates by the bot instance eessi-bot-mc-aws (click for details)
  • received bot command build inst:eessi-bot-mc-azure repo:eessi.io-2023.06-software arch:x86_64/amd/zen4 from trz42

    • expanded format: build instance:eessi-bot-mc-azure repository:eessi.io-2023.06-software architecture:x86_64/amd/zen4
  • handling command build instance:eessi-bot-mc-azure repository:eessi.io-2023.06-software architecture:x86_64/amd/zen4 resulted in:

    • no jobs were submitted

Copy link

eessi-bot bot commented Apr 20, 2024

Updates by the bot instance eessi-bot-mc-azure (click for details)
  • received bot command build inst:eessi-bot-mc-azure repo:eessi.io-2023.06-software arch:x86_64/amd/zen4 from trz42
    • expanded format: build instance:eessi-bot-mc-azure repository:eessi.io-2023.06-software architecture:x86_64/amd/zen4

@trz42
Copy link
Collaborator Author

trz42 commented Apr 20, 2024

Getting closer. However, hit another issue

RuntimeError: run_cmd(): Error running '/opt/software/slurm/bin/sbatch --hold --time=24:0:0 --nodes=1 --ntasks-per-node=16 --hold  --partition x86-64-amd-zen4-node /home/bot/eessi-bot-software-layer/scripts/bot-build.slurm' in '/project/def-users/SHARED/jobs/2024.04/pr_547/event_f4520850-fed5-11ee-9e5c-133a4f004b3e/run_000/linux_x86_64_amd_zen4/eessi.io-2023.06-software
           stdout ''
           stderr 'sbatch: error: Batch job submission failed: Invalid account or account/partition combination specified
'
           exit code 1

A simple srun ... fails too

srun --partition x86-64-amd-zen4-node --pty bash
srun: error: Unable to allocate resources: Invalid account or account/partition combination specified

@boegel
Copy link
Contributor

boegel commented Apr 20, 2024

@trz42 Seems fixed after a restart of Slurm service on mgmt node, please try again

@trz42
Copy link
Collaborator Author

trz42 commented Apr 20, 2024

bot: build inst:eessi-bot-mc-azure repo:eessi.io-2023.06-software arch:x86_64/amd/zen4

Copy link

eessi-bot bot commented Apr 20, 2024

Updates by the bot instance eessi-bot-mc-aws (click for details)
  • received bot command build inst:eessi-bot-mc-azure repo:eessi.io-2023.06-software arch:x86_64/amd/zen4 from trz42

    • expanded format: build instance:eessi-bot-mc-azure repository:eessi.io-2023.06-software architecture:x86_64/amd/zen4
  • handling command build instance:eessi-bot-mc-azure repository:eessi.io-2023.06-software architecture:x86_64/amd/zen4 resulted in:

    • no jobs were submitted

Copy link

eessi-bot bot commented Apr 20, 2024

Updates by the bot instance eessi-bot-mc-azure (click for details)
  • received bot command build inst:eessi-bot-mc-azure repo:eessi.io-2023.06-software arch:x86_64/amd/zen4 from trz42

    • expanded format: build instance:eessi-bot-mc-azure repository:eessi.io-2023.06-software architecture:x86_64/amd/zen4
  • handling command build instance:eessi-bot-mc-azure repository:eessi.io-2023.06-software architecture:x86_64/amd/zen4 resulted in:

Copy link

eessi-bot bot commented Apr 20, 2024

New job on instance eessi-bot-mc-azure for architecture x86_64-amd-zen4 for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.04/pr_547/52

  • reports "ERROR" very early (before building anything), then goes on and builds successfully (for each line its number in the slurm output file is shown)
     104  >> Picking up pre-defined $EESSI_SOFTWARE_SUBDIR_OVERRIDE: x86_64/amd/zen4
     105  ESC[31mERROR: Lmod configuration file not found at /cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/amd/zen4/.lmod/lmodrc.luaESC[0m
     106  ESC[31mERROR: Lmod SitePackage.lua file not found at /cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/amd/zen4/.lmod/SitePackage.luaESC[0m
    
date job status comment
Apr 20 07:55:42 UTC 2024 submitted job id 52 awaits release by job manager
Apr 20 07:56:19 UTC 2024 released job awaits launch by Slurm scheduler
Apr 20 07:57:22 UTC 2024 running job 52 is running
Apr 20 08:23:54 UTC 2024 finished
😢 FAILURE (click triangle for details)
Details
✅ job output file slurm-52.out
❌ found message matching ERROR:
✅ no message matching FAILED:
✅ no message matching required modules missing:
✅ found message(s) matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-amd-zen4-1713601135.tar.gzsize: 19 MiB (20841441 bytes)
entries: 32613
modules under 2023.06/software/linux/x86_64/amd/zen4/modules/all
EasyBuild/4.9.1.lua
software under 2023.06/software/linux/x86_64/amd/zen4/software
EasyBuild/4.9.1
other under 2023.06/software/linux/x86_64/amd/zen4
.lmod/SitePackage.lua
.lmod/lmodrc.lua
Apr 20 08:23:54 UTC 2024 test result
😢 FAILURE (click triangle for details)
Reason
EESSI test suite produced failures.
ReFrame Summary
[ FAILED ] Ran 9/9 test case(s) from 9 check(s) (6 failure(s), 0 skipped, 0 aborted)
Details
✅ job output file slurm-52.out
❌ found message matching ERROR:
❌ found message matching [\s*FAILED\s*].*Ran .* test case

@trz42
Copy link
Collaborator Author

trz42 commented Apr 20, 2024

Rebuilding after change which tries to ensure lmod cfg files are created early if they don't exist.

bot: build inst:eessi-bot-mc-azure repo:eessi.io-2023.06-software arch:x86_64/amd/zen4

Copy link

eessi-bot bot commented Apr 20, 2024

Updates by the bot instance eessi-bot-mc-aws (click for details)
  • received bot command build inst:eessi-bot-mc-azure repo:eessi.io-2023.06-software arch:x86_64/amd/zen4 from trz42

    • expanded format: build instance:eessi-bot-mc-azure repository:eessi.io-2023.06-software architecture:x86_64/amd/zen4
  • handling command build instance:eessi-bot-mc-azure repository:eessi.io-2023.06-software architecture:x86_64/amd/zen4 resulted in:

    • no jobs were submitted

Copy link

eessi-bot bot commented Apr 20, 2024

Updates by the bot instance eessi-bot-mc-azure (click for details)
  • received bot command build inst:eessi-bot-mc-azure repo:eessi.io-2023.06-software arch:x86_64/amd/zen4 from trz42

    • expanded format: build instance:eessi-bot-mc-azure repository:eessi.io-2023.06-software architecture:x86_64/amd/zen4
  • handling command build instance:eessi-bot-mc-azure repository:eessi.io-2023.06-software architecture:x86_64/amd/zen4 resulted in:

Copy link

eessi-bot bot commented Apr 20, 2024

New job on instance eessi-bot-mc-azure for architecture x86_64-amd-zen4 for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.04/pr_547/55

date job status comment
Apr 20 12:14:32 UTC 2024 submitted job id 55 awaits release by job manager
Apr 20 12:15:19 UTC 2024 released job awaits launch by Slurm scheduler
Apr 20 12:16:22 UTC 2024 running job 55 is running
Apr 20 12:18:25 UTC 2024 finished
🤷 UNKNOWN (click triangle for detailed information)
  • Job results file _bot_job55.result does not exist in job directory or reading it failed.
  • No artefacts were found/reported.
Apr 20 12:18:25 UTC 2024 test result
🤷 UNKNOWN (click triangle for detailed information)
  • Job test file _bot_job55.test does not exist in job directory or reading it failed.

@trz42
Copy link
Collaborator Author

trz42 commented Apr 20, 2024

Small mistake (wrong script used) fixed

bot: build inst:eessi-bot-mc-azure repo:eessi.io-2023.06-software arch:x86_64/amd/zen4

Copy link

eessi-bot bot commented Apr 20, 2024

Updates by the bot instance eessi-bot-mc-aws (click for details)
  • received bot command build inst:eessi-bot-mc-azure repo:eessi.io-2023.06-software arch:x86_64/amd/zen4 from trz42

    • expanded format: build instance:eessi-bot-mc-azure repository:eessi.io-2023.06-software architecture:x86_64/amd/zen4
  • handling command build instance:eessi-bot-mc-azure repository:eessi.io-2023.06-software architecture:x86_64/amd/zen4 resulted in:

    • no jobs were submitted

Copy link

eessi-bot bot commented Apr 20, 2024

Updates by the bot instance eessi-bot-mc-azure (click for details)
  • received bot command build inst:eessi-bot-mc-azure repo:eessi.io-2023.06-software arch:x86_64/amd/zen4 from trz42

    • expanded format: build instance:eessi-bot-mc-azure repository:eessi.io-2023.06-software architecture:x86_64/amd/zen4
  • handling command build instance:eessi-bot-mc-azure repository:eessi.io-2023.06-software architecture:x86_64/amd/zen4 resulted in:

Copy link

eessi-bot bot commented Apr 20, 2024

New job on instance eessi-bot-mc-azure for architecture x86_64-amd-zen4 for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.04/pr_547/56

date job status comment
Apr 20 12:19:42 UTC 2024 submitted job id 56 awaits release by job manager
Apr 20 12:20:28 UTC 2024 released job awaits launch by Slurm scheduler
Apr 20 12:21:31 UTC 2024 running job 56 is running
Apr 20 12:27:38 UTC 2024 finished
😢 FAILURE (click triangle for details)
Details
✅ job output file slurm-56.out
❌ found message matching ERROR:
✅ no message matching FAILED:
✅ no message matching required modules missing:
✅ found message(s) matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-amd-zen4-1713615752.tar.gzsize: 19 MiB (20841262 bytes)
entries: 32613
modules under 2023.06/software/linux/x86_64/amd/zen4/modules/all
EasyBuild/4.9.1.lua
software under 2023.06/software/linux/x86_64/amd/zen4/software
EasyBuild/4.9.1
other under 2023.06/software/linux/x86_64/amd/zen4
.lmod/SitePackage.lua
.lmod/lmodrc.lua
Apr 20 12:27:38 UTC 2024 test result
😢 FAILURE (click triangle for details)
Reason
EESSI test suite produced failures.
ReFrame Summary
[ FAILED ] Ran 9/9 test case(s) from 9 check(s) (6 failure(s), 0 skipped, 0 aborted)
Details
✅ job output file slurm-56.out
❌ found message matching ERROR:
❌ found message matching [\s*FAILED\s*].*Ran .* test case

@trz42
Copy link
Collaborator Author

trz42 commented Apr 20, 2024

bot: build inst:eessi-bot-mc-azure repo:eessi.io-2023.06-software arch:x86_64/amd/zen4

Copy link

eessi-bot bot commented Apr 20, 2024

Updates by the bot instance eessi-bot-mc-aws (click for details)
  • received bot command build inst:eessi-bot-mc-azure repo:eessi.io-2023.06-software arch:x86_64/amd/zen4 from trz42

    • expanded format: build instance:eessi-bot-mc-azure repository:eessi.io-2023.06-software architecture:x86_64/amd/zen4
  • handling command build instance:eessi-bot-mc-azure repository:eessi.io-2023.06-software architecture:x86_64/amd/zen4 resulted in:

    • no jobs were submitted

Copy link

eessi-bot bot commented Apr 20, 2024

Updates by the bot instance eessi-bot-mc-azure (click for details)
  • received bot command build inst:eessi-bot-mc-azure repo:eessi.io-2023.06-software arch:x86_64/amd/zen4 from trz42

    • expanded format: build instance:eessi-bot-mc-azure repository:eessi.io-2023.06-software architecture:x86_64/amd/zen4
  • handling command build instance:eessi-bot-mc-azure repository:eessi.io-2023.06-software architecture:x86_64/amd/zen4 resulted in:

Copy link

eessi-bot bot commented Apr 20, 2024

New job on instance eessi-bot-mc-azure for architecture x86_64-amd-zen4 for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.04/pr_547/57

date job status comment
Apr 20 12:41:35 UTC 2024 submitted job id 57 awaits release by job manager
Apr 20 12:41:43 UTC 2024 released job awaits launch by Slurm scheduler
Apr 20 12:42:46 UTC 2024 running job 57 is running
Apr 20 12:45:51 UTC 2024 finished
😢 FAILURE (click triangle for details)
Details
✅ job output file slurm-57.out
✅ no message matching ERROR:
✅ no message matching FAILED:
✅ no message matching required modules missing:
❌ no message matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-amd-zen4-1713616911.tar.gzsize: 0 MiB (2500 bytes)
entries: 2
modules under 2023.06/software/linux/x86_64/amd/zen4/modules/all
no module files in tarball
software under 2023.06/software/linux/x86_64/amd/zen4/software
no software packages in tarball
other under 2023.06/software/linux/x86_64/amd/zen4
.lmod/SitePackage.lua
.lmod/lmodrc.lua
Apr 20 12:45:51 UTC 2024 test result
🤷 UNKNOWN (click triangle for detailed information)
  • Job test file _bot_job57.test does not exist in job directory or reading it failed.

@trz42
Copy link
Collaborator Author

trz42 commented Apr 20, 2024

bot: build inst:eessi-bot-mc-azure repo:eessi.io-2023.06-software arch:x86_64/amd/zen4

Copy link

eessi-bot bot commented Apr 20, 2024

Updates by the bot instance eessi-bot-mc-aws (click for details)
  • received bot command build inst:eessi-bot-mc-azure repo:eessi.io-2023.06-software arch:x86_64/amd/zen4 from trz42

    • expanded format: build instance:eessi-bot-mc-azure repository:eessi.io-2023.06-software architecture:x86_64/amd/zen4
  • handling command build instance:eessi-bot-mc-azure repository:eessi.io-2023.06-software architecture:x86_64/amd/zen4 resulted in:

    • no jobs were submitted

Copy link

eessi-bot bot commented Apr 20, 2024

Updates by the bot instance eessi-bot-mc-azure (click for details)
  • received bot command build inst:eessi-bot-mc-azure repo:eessi.io-2023.06-software arch:x86_64/amd/zen4 from trz42

    • expanded format: build instance:eessi-bot-mc-azure repository:eessi.io-2023.06-software architecture:x86_64/amd/zen4
  • handling command build instance:eessi-bot-mc-azure repository:eessi.io-2023.06-software architecture:x86_64/amd/zen4 resulted in:

Copy link

eessi-bot bot commented Apr 20, 2024

New job on instance eessi-bot-mc-azure for architecture x86_64-amd-zen4 for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.04/pr_547/58

date job status comment
Apr 20 12:46:02 UTC 2024 submitted job id 58 awaits release by job manager
Apr 20 12:46:54 UTC 2024 released job awaits launch by Slurm scheduler
Apr 20 12:47:57 UTC 2024 running job 58 is running
Apr 20 12:54:10 UTC 2024 finished
😁 SUCCESS (click triangle for details)
Details
✅ job output file slurm-58.out
✅ no message matching ERROR:
✅ no message matching FAILED:
✅ no message matching required modules missing:
✅ found message(s) matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-amd-zen4-1713617341.tar.gzsize: 19 MiB (20848896 bytes)
entries: 32613
modules under 2023.06/software/linux/x86_64/amd/zen4/modules/all
EasyBuild/4.9.1.lua
software under 2023.06/software/linux/x86_64/amd/zen4/software
EasyBuild/4.9.1
other under 2023.06/software/linux/x86_64/amd/zen4
.lmod/SitePackage.lua
.lmod/lmodrc.lua
Apr 20 12:54:10 UTC 2024 test result
😢 FAILURE (click triangle for details)
Reason
EESSI test suite produced failures.
ReFrame Summary
[ FAILED ] Ran 9/9 test case(s) from 9 check(s) (6 failure(s), 0 skipped, 0 aborted)
Details
✅ job output file slurm-58.out
❌ found message matching ERROR:
❌ found message matching [\s*FAILED\s*].*Ran .* test case

@trz42 trz42 mentioned this pull request Apr 20, 2024
# stack, we need to ensure certain files are present in
# ${EESSI_PREFIX}/software/${EESSI_OS_TYPE}/${EESSI_SOFTWARE_SUBDIR_OVERRIDE}
# - .lmod/lmodrc.lua
# - .lmod/SitePackage.lua
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@trz42 Why do these need to be in place exactly?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It seems these files are needed when init/eessi_environment_variables is sourced. The actual build may still work, but the issue is that the non-existence of these files creates ERROR messages in the slurm output file. The bot/check-build.sh thus considers the job being failed.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

OK, also have to do this here probably means that the same calls at the end of the script are just doing it too late, and it should be moved here (rather than copied)?

I'm happy to merge this as if for now, there's no negative impact when having it on both places, but it's silly, and duplicated code, so we should clean that up afterwards.

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think we need to have the files created early. As it is now it creates them at the beginning if they don't exist. At the end they are created if they don't exist or if they have changed. So if we check for the change at the beginning we may remove the creation at the end.

easyconfigs:
- EasyBuild-4.9.1.eb:
options:
from-pr: 20299
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ideally we use --from-commit here, but that's an ongoing discussion in #558, so we can follow it up there, there's some confusion on which commits should be used exactly, so that can be followed-up in there.

@boegel boegel changed the title zen4-only {2023.06}[system] EasyBuild v4.9.1 {2023.06,zen4}[system] EasyBuild v4.9.1 May 7, 2024
@boegel
Copy link
Contributor

boegel commented May 7, 2024

@trz42 Seems ready to deploy?

@trz42 trz42 added the ready-to-deploy Mark a PR as ready to deploy label May 7, 2024
@boegel
Copy link
Contributor

boegel commented May 7, 2024

bot: build repo:eessi.io-2023.06-software arch:x86_64/amd/zen4

Copy link

eessi-bot bot commented May 7, 2024

Updates by the bot instance eessi-bot-mc-aws (click for details)
  • received bot command build repo:eessi.io-2023.06-software arch:x86_64/amd/zen4 from boegel

    • expanded format: build repository:eessi.io-2023.06-software architecture:x86_64/amd/zen4
  • handling command build repository:eessi.io-2023.06-software architecture:x86_64/amd/zen4 resulted in:

    • no jobs were submitted

Copy link

eessi-bot bot commented May 7, 2024

Updates by the bot instance eessi-bot-mc-azure (click for details)
  • received bot command build repo:eessi.io-2023.06-software arch:x86_64/amd/zen4 from boegel

    • expanded format: build repository:eessi.io-2023.06-software architecture:x86_64/amd/zen4
  • handling command build repository:eessi.io-2023.06-software architecture:x86_64/amd/zen4 resulted in:

Copy link

eessi-bot bot commented May 7, 2024

New job on instance eessi-bot-mc-azure for architecture x86_64-amd-zen4 for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.05/pr_547/68

date job status comment
May 07 10:39:32 UTC 2024 submitted job id 68 awaits release by job manager
May 07 10:40:14 UTC 2024 released job awaits launch by Slurm scheduler
May 07 10:45:17 UTC 2024 running job 68 is running
May 07 10:53:29 UTC 2024 finished
😁 SUCCESS (click triangle for details)
Details
✅ job output file slurm-68.out
✅ no message matching ERROR:
✅ no message matching FAILED:
✅ no message matching required modules missing:
✅ found message(s) matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-amd-zen4-1715078839.tar.gzsize: 19 MiB (20845408 bytes)
entries: 32614
modules under 2023.06/software/linux/x86_64/amd/zen4/modules/all
EasyBuild/4.9.1.lua
software under 2023.06/software/linux/x86_64/amd/zen4/software
EasyBuild/4.9.1
other under 2023.06/software/linux/x86_64/amd/zen4
.lmod/SitePackage.lua
.lmod/lmodrc.lua
2023.06/init/arch_specs/eessi_arch_x86.spec
May 07 10:53:29 UTC 2024 test result
😢 FAILURE (click triangle for details)
Reason
EESSI test suite produced failures.
ReFrame Summary
[ FAILED ] Ran 10/10 test case(s) from 10 check(s) (7 failure(s), 0 skipped, 0 aborted)
Details
✅ job output file slurm-68.out
❌ found message matching ERROR:
❌ found message matching [\s*FAILED\s*].*Ran .* test case
May 07 10:55:20 UTC 2024 uploaded transfer of eessi-2023.06-software-linux-x86_64-amd-zen4-1715078839.tar.gz to S3 bucket succeeded

@boegel
Copy link
Contributor

boegel commented May 7, 2024

rebuilding to pick up fix for archspec that was merged in #451 but not deployed yet...

@boegel boegel added bot:deploy Ask bot to deploy missing software installations to EESSI and removed ready-to-deploy Mark a PR as ready to deploy labels May 7, 2024
@bedroge bedroge merged commit 4a6cd25 into EESSI:2023.06-software.eessi.io May 7, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
2023.06-software.eessi.io 2023.06 version of software.eessi.io bot:deploy Ask bot to deploy missing software installations to EESSI zen4
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants